Super-Resolution Optical Flow
نویسنده
چکیده
Existing approaches to super-resolution are not applicable to videos of faces because faces are non-planar, non-rigid, non-lambertian, and are subject to self occlusion. We present super-resolution optical ow as a solution to these problems. Super-resolution optical ow takes as input a conventional video stream, and simultaneously computes both optical ow and a super-resolution version of the entire video. In this paper we describe an initial implementation of super-resolution optical ow, present detailed experimental results, and describe the relationship between super-resolution optical ow and pyramid-based image representations such as the Laplacian pyramid.
منابع مشابه
Super-resolution and Optical Flow reliability fields
Accurate optical flow estimation of motion fields is crucial for video super-resolution algorithms. Existing algorithms for optical flow calculation may produce erroneous motion fields on complex dynamic scenes with multiple moving, occluding non-rigid objects. In this paper we propose to use so called optical flow reliability weights in order to reduce impact of erroneous motion vector estimat...
متن کاملEnd-to-End Learning of Video Super-Resolution with Motion Compensation
Learning approaches have shown great success in the task of super-resolving an image given a low resolution input. Video superresolution aims for exploiting additionally the information from multiple images. Typically, the images are related via optical flow and consecutive image warping. In this paper, we provide an end-to-end video superresolution network that, in contrast to previous works, ...
متن کاملImproving Super-Resolution Enhancement of Video by using Optical Flow
In the literature there has been much research into two methods of attacking the super-resolution problem: using optical flow-based techniques to align low-resolution images as samples of a target high-resolution image, and using learning-based techniques to estimate perceptuallyplausible high frequency components of a low-resolution image. Both of these approaches have been naturally extended ...
متن کاملAutomatic Tracking, Super-Resolution and Recognition of Human Faces from Surveillance Video
Identifying an individual from surveillance video is a difficult, time consuming and labour intensive process. The proposed system aims to streamline this process by filtering out unwanted scenes and enhancing an individual’s face through super-resolution. An automatic face recognition system is then used to identify the subject or present the human operator with likely matches from a database....
متن کاملIs Super-Resolution with Optical Flow Feasible?
Reconstruction-based super-resolution frommotion video has been an active area of study in computer vision and video analysis. Image alignment is a key component of super-resolution algorithms. Almost all previous super-resolution algorithms have assumed that standard methods of image alignment can provide accurate enough alignment for creating super-resolution images. However, a systematic stu...
متن کامل